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METHOD OF COLOR CAPTURE CALIBRATION 
FOR DIGITAL CAPTURE DEVICES 



TECHNICAL FIELD 

This invention relates generally to the calibration of digital graphic capture 
devices and, more particularly, to a calibration procedure for digital capture devices based 
on the human visual system perception of colors to ensure high color fidelity of the 
captured image. 

BACKGROUND OF THE INVENTION 

Color calibration of digital image capture devices is important to maintain a high 
fidelity of the captured image so that a representative image of the item captured may be 
displayed to a consumer or user of the digital image. This high fidelity becomes more 
and more important as web-based commerce continues to expand. This may be 
appreciated as consumers begin to rely more heavily on these images and the accuracy of 
the colors represented thereon for their purchase decisions. For consumers to continue to 
expand their usage of web-based commerce, a certain minimum acceptable level of color 
fidelity quality must be established. Further, this color fidelity must be such that the 
digital counts output from the capture devices accurately represent the colors as they 
would appear to a typical human observer. An accurate relationship is necessary to 
enable reliable digital commerce where users make purchase decisions based upon the 
trust that the digitally captured image represents the original color appearance of the 
captured object that is represented in the digital image. 
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While various methods exist for the calibration of these digital image capture 
devices, these methods have, to date, required the acquisition of expensive calibration 
equipment (in the range of $25,000) and the employment of highly trained color 
scientists. Examples of these calibration procedures may be found in various books and 
5 standards, such as Color Management (GATF), Color Management (Giorgiaimi), the IEC 
61966-9 draft specification, and the ISO 17321 draft specification. Calibration facilities 
and procedures may also be contracted out to specialized laboratories. However, the cost 
of such calibration services is typically in the range of $20,000 per calibration. As a 
result, many vendors of these capture devices, especially second and third tier vendors of 
1 0 inexpensive equipment, do not perform this calibration, or perform only a simplified 

calibration. As a result, many of the images published on the web or used in other media 
that have been captured by these devices have questionable color fidelity. 

SUMMARY OF THE INVENTION 

1 5 The inventive concepts of the instant invention involve the calibration of digital 

image capture devices such as digital cameras, scanners, etc. Recognizing the importance 
of high color fidelity in a competitive commercial environment which will not bear the 
tremendous expense of prior color calibration methods, the instant invention provides a 
simple and inexpensive method to ensure a high level of color fidelity that is acceptable 

2 0 for conducting true e-commerce. This method also reduces the error introduced by even 
the most expensive calibration equipment into the calibration process, and does so with 
inexpensive and custom color targets. It performs its calibration through the use of a 
simple regression, such as may be performed by a conventional electronic spreadsheet 
program, e.g. Excel, etc. Of course, a specialized regression algorithm could be used 
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instead of a conventional spreadsheet, and a multi-linear regression could replace the 
simple regression, depending on the system requirements. As a result of this method, all 
digital image capture devices may deliver the high fidelity required in today's e- 
commerce environment. 
5 Specifically, the method begins by simply acquiring a test target, such as an ANSI 

IT8, IEC, Q60, MacBeth, etc. color characterization target and its measurement values, 
including the white point values. This procedure also allows for the use of custom color 
targets as desired. Preferably, the target provides at least 6 points, although the 
calibration method achieves acceptable results with as little as 3 color points plus the 

1 0 white and black samples. Higher color fidelity may be achieved by providing more 

points. This step does not require that the colors be measured in any way, only that the 
values of the targets be provided in a physical color space, e.g. CIE 1931 XYZ, CIE 1976 
LAB, CIECAM, CIELUV, etc. values. This dispenses with the necessity of an expensive 
spectrometer or spectrophotometer. These values, e.g., of the target are then loaded or 

1 5 entered into a spreadsheet, such as preferably Excel. These entered values are then 
normalized to a range of 0 to 1 based on the minimum (black) and maximum (white) 
values. 

Next, the value of the light source white point is obtained either through the use of 
a low cost colorimeter or from the published values of the source. For example, the 
2 0 scanner white point chromaticity values may be obtained from the device vendor. The 
target white point is then converted to the capture device white point based on simplified 
CIE Bradford white point adaptation equations. Alternatively, other white point 
adaptation algorithms known in the art may be used, such as, for example, the full blown 



Bradford, Von Kries, etc. This will provide the key for the conversion between the target 
values and those captured from the target. The raw RGB values of the test target are then 
captured using capture device. It is important that any color management processing, 
including any gamma correction, of the capture device is disabled during this process. 
These raw RGB values are then normalized to a range of 0 to 1 based on the minimum 
(black) and maximum (white) values. 

Using the spreadsheet's regression methods (which may be a simple linear 
regression, or a more complex non-linear, multi-linear, etc. regression) provided by, e.g., 
Excel' s Analysis ToolPak, regress predicted X values based on the normalized X and 
normalized RGB values without any offset. This results in a 1x3 matrix. This step is 
repeated for the Y values and the Z values, each time resulting in a 1x3 matrix. These 
three matrices are then combined into a single 3x3 matrix, from which the computer 
predicted CIE XYZ values may be obtained. As will be recognized by one skilled in the 
art, the use of a multi-linear regression can create a single 3x3 matrix in one step instead 
of the three steps described above. The test target CIE XYZ values in the device white 
point are used with these predicted CIE XYZ values to compute CIE 1996 color 
difference values, including average, standard deviation, minimum and maximum delta 
E*, etc. Based on these values, the predicted accuracy of the capture device is evaluated 
in the context of its application. Typically an average delta E* of 6 or less is required and 
3 or less is desired. 

If an acceptable accuracy is achieved, this method then uses the simplified 
Bradford white point adaptation equations to convert predicted CIE XYZ values from the 
device white point to D65 (white point of sRGB). As discussed above, the official CIE 
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Bradford equation (including a non-linear aspect for the blue channel) may also be used, 
or the Von Kries or other algorithms as desired. Next, these values are converted into 
linear RGB values using the CIE XYZ to RGB matrix from the IEC 61966-2-1 sRGB 
standard. Finally, these converted values are further converted into sRGB output values 
5 using linear to nonlinear tone equations from IEC 61966-2-1 sRGB standard. If an ICC 
profile is required, the combination of the three 1x3 matrices and a simple tone curve fit 
of the gray scale data can be used in known fashion. Of course, one skilled in the art will 
recognize that the output values may be converted to other color spaces as desired. 
Exemplary additional color spaces, although by no means exhaustive, may be sRGB64, 

10 AdobeRGB, etc. 

Previous inventions required extensive measurement of the test target to insure the 
measured white point is identical to the device white point or reworking the device to 
make the device white point match the published test target white point. Also, most 
previous inventions ignored normalization of the minimum values or black point and only 

1 5 concentrated on the white point. 

Additional features and advantages of the invention will be made apparent from 
the following detailed description of illustrative embodiments, which proceeds with 
reference to the accompanying figures. 



20 



BRIEF DESCRIPTION OF THE DRAWINGS 

While the appended claims set forth the features of the present invention with 
particularity, the invention, together with its objects and advantages, may be best 



understood from the following detailed description taken in conjunction with the 
accompanying drawings of which: 

Figure 1 is a block diagram generally illustrating an exemplary computer system 
on which the present invention resides; 

Figure 2 is a simplified illustration of the translation of a digital image from an 
input device color space to a device independent communication color space to an output 
device color space; 

Figure 3 is a block diagram illustrating a calibration procedure for a digital image 
capture device; 

Figures 4a-d illustrate a process flow diagram illustrating an embodiment of the 
method of the instant invention; and 

Figure 5 is a block diagrammatic illustration of a digital image capture device 
having image data compensation and conversion in accordance with the instant invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Turning to the drawings, wherein like reference numerals refer to like elements, 
the invention is illustrated as being implemented in a suitable computing environment. 
Although not required, the invention will be described in the general context of computer- 
executable instructions, such as program modules, being executed by a personal 
computer. Generally, program modules include routines, programs, objects, components, 
data structures, etc. that perform particular tasks or implement particular abstract data 
types. Moreover, those skilled in the art will appreciate that the invention may be 
practiced with other computer system configurations, including hand-held devices, multi- 
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processor systems, microprocessor based or programmable consumer electronics, network 
PCs, minicomputers, mainframe computers, and the like. The invention may also be 
practiced in distributed computing environments where tasks are performed by remote 
processing devices that are linked through a communications network. In a distributed 
5 computing environment, program modules may be located in both local and remote 
memory storage devices. 

With reference to Fig. 1, an exemplary system for implementing the invention 
includes a general purpose computing device in the form of a conventional personal 
computer 20, including a processing unit 21, a system memory 22, and a system bus 23 

1 0 that couples various system components including the system memory to the processing 
unit 21. The system bus 23 may be any of several types of bus structures including a 
memory bus or memory controller, a peripheral bus, and a local bus using any of a variety 
of bus architectures. The system memory includes read only memory (ROM) 24 and 
random access memory (RAM) 25. A basic input/output system (BIOS) 26, containing 

1 5 the basic routines that help to transfer information between elements within the personal 
computer 20, such as during start-up, is stored in ROM 24. The personal computer 20 
further includes a hard disk drive 27 for reading from and writing to a hard disk, not 
shown, a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 
29, and an optical disk drive 30 for reading from or writing to a removable optical disk 31 

2 0 such as a CD ROM or other optical media. 

The hard disk drive 27, magnetic disk drive 28, and optical disk drive 30 are 
connected to the system bus 23 by a hard disk drive interface 32, a magnetic disk drive 
interface 33, and an optical disk drive interface 34, respectively. The drives and their 
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associated computer-readable media provide nonvolatile storage of computer readable 
instructions, data structures, program modules and other data for the personal computer 
20. Although the exemplary environment described herein employs a hard disk, a 
removable magnetic disk 29, and a removable optical disk 31, it will be appreciated by 
those skilled in the art that other types of computer readable media which can store data 
that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital 
video disks, Bernoulli cartridges, random access memories, read only memories, and the 
like may also be used in the exemplary operating environment. 

A number of program modules may be stored on the hard disk, magnetic disk 29, 
optical disk 31, ROM 24 or RAM 25, including an operating system 35, one or more 
applications programs 36, other program modules 37, and program data 38. A user may 
enter commands and information into the personal computer 20 through input devices 
such as a keyboard 40 and a pointing device 42. Other input devices (not shown) may 
include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and 
other input devices are often connected to the processing unit 21 through a serial port 
interface 46 that is coupled to the system bus, but may be connected by other interfaces, 
such as a parallel port, game port or a universal serial bus (USB). A monitor 47 or other 
type of display device is also connected to the system bus 23 via an interface, such as a 
video adapter 48. In addition to the monitor, personal computers typically include other 
peripheral output devices, not shown, such as speakers and printers. 

The personal computer 20 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 49. The 
remote computer 49 may be another personal computer, a server, a router, a network PC, 



a peer device or other common network node, and typically includes many or all of the 
elements described above relative to the personal computer 20, although only a memory 
storage device 50 has been illustrated in Fig. 1. The logical connections depicted in Fig. 
1 include a local area network (LAN) 5 1 and a wide area network (WAN) 52. Such 
networking environments are commonplace in offices, enterprise-wide computer 
networks, intranets and the Internet. 

When used in a LAN networking environment, the personal computer 20 is 
connected to the local network 51 through a network interface or adapter 53. When used 
in a WAN networking environment, the person computer 20 typically includes a modem 
54 or other means for establishing communications over the WAN 52. The modem 54, 
which may be internal or external, is connected to the system bus 23 via the serial port 
interface 46. In a networked environment, program modules depicted relative to the 
personal computer 20, or portions thereof, may be stored in the remote memory storage 
device. It will be appreciated that the network connections shown are exemplary and 
other means of establishing a communications link between the computers may be used. 

In the description that follows, the invention will be described with reference to 
acts and symbolic representations of operations that are performed by one or more 
computer, unless indicated otherwise. As such, it will be understood that such acts and 
operations, which are at times referred to as being computer-executed, include the 
manipulation by the processing unit of the computer of electrical signals representing data 
in a structured form. This manipulation transforms the data or maintains it at locations in 
the memory system of the computer, which reconfigures or otherwise alters the operation 
of the computer in a manner well understood by those skilled in the art. The data 
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structures where data is maintained are physical locations of the memory that have 
particular properties defined by the format of the data. However, while the invention is 
being described in the foregoing context, it is not meant to be limiting as those of skill in 
the art will appreciate that various of the acts and operation described hereinafter may 
also be implemented in hardware. 

The necessity of color calibration exists primarily because every machine in a 
digital image processing system operates within its own color space. As used herein, the 
term "digital image processing system" may include an end-to-end system of e- 
commerce, including the digital image capture device, the web server on which the image 
is hosted, and the personal computer on which the image is viewed by a user. However, 
the term may also refer to a system as simple as a digital image capture device and a 
display device. Regardless of the components that make up a digital image processing 
system, each one processes the captured image in its own color space. For a digital image 
capture device, which may be, e.g., a scanner or camera, the color space is typically RGB. 
When the image is displayed on a monitor, RGB still defines the color space, but now it 
is the RGB color space of the monitor, which most often will differ from that of the 
camera. If the image is then printed, the image is once again transferred to the color 
space of the printer, which is most often CMYK. 

Transformations from the color space of one component 56 to that of another 60 is 
accomplished, most typically, by performing a transformation to a device independent 
communication color space 58, such as CIELAB, CIELUV, CIECAM, sRGB, etc. as 
illustrated in Figure 2. The image in the device independent communication color space 
58 is then transformed to the color space of the output device 60 for display or printing. 
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This allows interchangability of components because device-to-device transformations 
are not necessary. Therefore, each device need only know how to perform 
transformations to and from its color space 56, 60 from and to the independent 
communication color space 58. 

Calibration is necessary at each component level to maintain the color fidelity of 
the original object. Specifically, if the image captured by digital image capture device has 
poor color fidelity, that image will continue to have poor fidelity because the 
transformations between color spaces at best simply maintains the color fidelity of the 
image data that is transformed. At a basic level, calibration of a device such as a digital 
image capture device is performed as illustrated in Figure 3. A color target 62, such as 
ANSI IT8, IEC, Q60, MacBeth, ISO equivalent, etc., is scanned or otherwise captured via 
the capture device to be calibrated, such as scanner 64. The output raw data of the 
captured target image in the capture device's color space, such as an RGB file 66, is 
produced and input to a computer 68. 

The theoretical or published device independent measurement values of the target 
70 are also input to the computer 68. The computer 68 performs a comparison of the 
measured values for the target 66 and the actual or theoretical values 70. The deviations 
between actual and theoretical values provide exact information on the color space and 
character of the capture device 64 from which the color profile 72 of the device 64 is 
determined. This color profile 72 may then be used by the capture device 64 to "adjust" 
its raw output data to obtain a high color fidelity of the images that it captures. 

While this general method of color calibration is well known, the particular 
algorithms used by the computer 68 in generating the color profile may differ 
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significantly in terms of both complexity and processing time. Additionally, the 
requirements for the targets 62 for these algorithms differ significantly and may 
significantly impact the cost of the calibration. The calibration method of the instant 
invention allows for simple calculations that may be performed on an electronic 
5 spreadsheet, and the use of inexpensive and even custom targets. It does so by taking 
advantage of a priori knowledge of the capture device white point, the assumed target 
white point, and recent knowledge of how humans perceive scaling white and black. 
With this, the method of the instant invention implements a relatively simple procedure 
that yields highly accurate results. While it does not account for different white points or 

10 a variety of other viewing condition factors, it does address the "80%" solution that is 
needed by the mass market. In fact, most product capture workflows use well known 
white points that fit well into the method of the instant invention. This fact is ignored by 
most academic solutions currently being proposed to calibration capture devices in their 
quest for a perfect solution. 

15 As indicated above, the calibration procedure of the instant invention preferably 

utilizes a physically based color space to ensure that the digital values accurately 
represent the colors as they would appear to a typical human observer. One such system 
applicable to the instant method, although by no means the only color system, is the CIE 
1931 XYZ color space defined by the Commission Internationale de V Eclair age. This 

2 0 color standard is based on imaginary primary colors XYZ, which do not exist physically. 
They are purely theoretical and independent of device-dependent color gamuts such as 
RGB or CYMK. These virtual primary colors have, however, been selected so that all 
colors that can be perceived by the human eye lie within their color space. This relates to 
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the tristimulus theory of color perception, that states that the human retina has three kinds 
of cones with peak sensitivities to 580 nm ("red"), 545 rim ("green"), and 440 nm 
("blue:). These primaries are combined in an additive manner, an advantage over other 
color models (such as RGB) where negative weights may be needed to specify some 
colors. Since one person's eye may vary from another person's, CIE defines a standard 
observer whose spectral response corresponds to the average response of the population. 
This makes the colorimetric determination of colors much more objective. 

The three primary colors of the CIE 193 1 XYZ system are based on a spatial 
model with coordinates X, Y, and Z. These three coordinates form a three-dimensional 
chromaticity triangle that is most often represented as a two-dimensional diagram 
projected into the red-green plane (X-Y plane). Since this two-dimensional diagram does 
not represent the Z coordinate, a standardization is performed so that it may be read 
nonetheless. This standardization defines chromaticity coordinates x, y, and z (lower 
case) defined as: 
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where : 
x y z 1 
therefore : 
z 1 x y 

As may be seen from these equations, the value of z of any desired color can be obtained 
by subtracting the chromaticity coordinates x and y from 1 . 
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The chromaticity values of x and y do not fully define a color without a brightness 
component. In the CIE XYZ system, the eye response curves are standardized so that 
they simultaneously reflect the sensation of brightness. Therefore, a color is only fully 
described in full using its chromaticity components x and y if a brightness component Y 
5 is also specified. In the standard color triangle, the right-angled chromaticity triangle 
drawn from zero, x=l, and y=l represents the boundaries of this reference system. 
Chromaticities cannot lie outside the triangle. The closed curve section of the CIE XYZ 
two-dimensional projection represents the position of the spectral colors. The primary 
colors RGB of a typical capture device form a triangle within the spectral color gamut 

1 0 having a smaller color gamut with the achromatic point approximately at its center. 

Turning now to an embodiment of the calibration procedure and method of the 
instant invention, as illustrated in Figure 4, the calibration is begun 100 by acquiring a 
test target 102 such as those described above, or a customized target. While more 
expensive targets provide many color patches, targets providing at least 50 to 70 patches 

15 are preferred, although inexpensive targets having as few as 24 patches provide very good 
results. Further, the method of the instant invention provides acceptable results utilizing 
targets with as few as 6 patches, such as a white, a black, a gray, and three primaries, 
either a red, a green, and a blue, or a cyan, a magenta, and a yellow. Actually, any three 
orthogonal colors are acceptable for the instant invention along with the necessary white 

2 0 and black samples. Further, the gray patch need not be in the middle, but can range 
anywhere from approximately 25% to 75% gray. This step assumes that the spectral 
makeup of the target is representative of the type of material of the objects whose digital 
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images will be captured. For example, while a photographic target will work reasonably 
well if the objects are textiles, the calibration may not yield completely accurate results. 

The test target measurement values are then determined 104, as is the capture 
devices' white point chromaticity 106. While the method of the instant invention may 
5 use values in any physical color space, the following description of an exemplary 

embodiment of the method of the instant invention will utilize the CIE XYZ color space 
for simplicity. However, this in no way limits the scope of the invention to that particular 
color system. Unlike many prior calibration procedures that require highly accurate and 
expensive equipment, these values may be obtained from the manufacturer. If the white 

1 0 point of the capture device is not known, a low cost colorimeter may be used to measure 
this. Further, the white point of the capture device may be extracted from the measured 
white point of the target. The test target measurement values are then normalized 1 08 to 
a range of 0-1 for the Q60 white point. Advantageously, the method of the instant 
invention normalizes to both the black (0) and the white (1). This normalization is 

1 5 performed in accordance with the following equations: 

* X X • 

Y y ♦ ta *get target min ^ 

^ norm 060 ^ Q6Q y _L 

target max target min 

* Y Y • 

y y ♦ target * target min ^_ 

*norm 060 060 y _L 

^target max target min zfc. 

* z z • 

y rj ^ target target mm _;_ 

20 L norm Q60 ^g60 7 _L 

%fr^ target max target min 

Once the test target measurement values have been normalized for the Q60 white 
point, they then are brought into the capture device's color space 110. This is unique to 
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the method of the instant invention. Typical methods require that the white point of the 
capture device be an "approved" white point. Unlike these prior methods, the instant 
invention works for any white point that exists for the capture device. This allows less 
expensive devices to be used in the capture device while still providing acceptable output 
and high color fidelity. Even if the capture device used a yellow light source, the images 
output from the device after translation will have a high fidelity to the original image or 
object. These values are transformed to the devices color space by converting to its white 
point 110 through the simplified Bradford white point adaptation equations as follows: 
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As discussed above, the full CIE Bradford algorithm, or others such as, for example, the 
Von Kries or a number of others may be used as desired. 
1 5 The images from the test target are captured 1 12 by the digital capture device to 

produce raw RGB values for the target. It is important to disable any gamma correction 
before the raw RGB values are captured. This step assumes a value of approximately 1.0 
for gamma. These raw RGB values for the test target are then normalized 1 14 to a range 
of 0-1 so that a proper comparison with the normalized measurement values form the 
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target may be accomplished. This normalization is accomplished through the following 
equations: 
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Regression analysis 1 16 is then performed on the normalized test target 
measurement values and the normalized RGB values to determine the expected 
measurement values. Essentially, this step 1 16 is predicting the best fit to convert the 
RGB values to what the predicted XYZ values should be. The data analysis capabilities 
of an electronic spreadsheet, such as Microsoft's Excel spreadsheet, may be utilized to 
perform this regression. Specifically, utilizing Excel' s Analysis ToolPak's regression 
analysis, this analysis may be performed by individually selecting the test target 
measurement values normalized to the capture device's color space X n0 rm-cam 5 Y n0 nn-cam, 
and Znorm-cam as the input y range, i.e. the range of dependent data. The matrix of 
normalized raw RGB values is selected as the input x range, i.e. the range of independent 
data. Preferably, the y-intercept is selected to be zero. The result of these three 
regressions is a 3X3 matrix of the expected measurement values in the color space of the 
capture device. Alternatively, a single multi-linear regression may be performed to 
achieve the 3x3 matrix as will be recognized by one skilled in the art. 
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This matrix of regressed values is then multiplied 118 by the matrix of normalized 
raw RGB values to determine the predicted measurement values of the test target in the 
color space of the capture device as follows: 

pred meas ^^regressX ^regressX ^regressX ^R raw norm = 
^^pred meas « ^-QregressY ^ regressY ^regressY ~£j£raw norm ~ 
^■pred meas ... ^^regressZ ^regress! ^regressZ ,^ raw norm ~- 

5 

Having now obtained the normalized test target measurement values, and 

calculated the predicted measurement values based on the raw RGB values from the 

capture device, CIE 1996 color difference values are calculated to determine how good of 

a calibration has been yielded. Since the CIE color difference calculations are performed 
****** 

10 in either CIEL u v or CIEL a b , conversion to one of these color spaces is necessary. In 

* * * 

the exemplary embodiment illustrated in Figure 4, the CIEL u v is chosen. These 
calculations include the calculations 120, 122, 124, 126, and 128 for the normalized test 
target measurement values in the capture device's color space, and calculations 130, 132, 
134, 136, and 138 for the predicted measurement values. The equations governing the 
1 5 calculations 120 are as follows: 



If normwn_ g Q.008856 

X 

^ whitepo int cam 



* X • * X • 16 

Then norm cam 7 787^- orm cam * 



' whitepo int cam 56 whitepo int cam ^ 116 

1/3 

* X • * X • 

Els€ f ^ norm cam _j_ + norm cam _l. 
whitepo int cam 56 



■ whitepo int cam zfi. 
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If nom cam 5 0.008856 

7 

whitepo int caw 

4» V • «fr F • 1 6 

The ft norm cam ~ 7 787 ^~ ffQrffl cgm — 



♦y -s- 4f ^116 

y^ whitepo int com ^ y^ whitepo int cam ^ 

1/3 

A F • •!• F 

y^ whitepo int cam ^£ y^ wi 



«<?/-m cam 



whitepo int cam ^£ 



^ nom_cam g 0.008856 



7 

whitepo int cam 



Then 



* Z • * Z • 16 

^norm cam j- y ygy ^ norm cam -i. x v 

♦Z " tZ 1 16 

y^ whitepo int cam 96 y^ whitepo int caw 56 



1/3 

•fc Z • «fr z 9 

£ fae — caw - 



norm cam 



♦z * *7 

y^ whitepo int cam ^£ y^ 



w/Htepoint ca/w 56 



The equation for meas L 122 for the normalized test target measurement values is 
as follows: 

¥ Ynorm cam & 0.008856 

Then meas £ norm cam 100 9.033Y norm cam 

Else ftieClS L norm cam 1001.16 7 _ 1/3 0.16 



The equation for meas a 124 for the normalized test target measurement values is 
as follows: 



* * X • * Y •• 

measa norm cam 500 — + /♦ ^ 

y ^ whitepo int cam 9*: 



w/irtepo int cam 96^ 



The equation for meas b 126 for the normalized test target measurement values is 
as follows: 

* * 7 • * Z •• 

/weosi „ 0 ,m cam 200 V * * /♦ — " omcqffl ^ 

y y* whitepo int cam y^ whitepo int cam 



The equation for meas C* 128 for the normalized test target measurement values 
is as follows: 
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measC norm cam \\ fflCCIS Q norm cam JflCQS D n 



These calculations are also performed, as stated above, for the predicted 
measurement values. For calculation 130, the following equations are used: 

If X P^meas 5 Q.QQ8856 

X 

whitepo mt cam 



Then 



Else 



r ^, pred meas ^_ y^gy^ pred meas ^ 

tX + +X * 

y^ w/wtejw int cam ^ ^ whitepo int cam ^£ 

* x . • * x . * 1/3 

- - /?raz meas ^ pred meas 



Else /♦ — preaw ^ j J- 

whitepo int cam 96 



whitepo int cam ^ 



TjT 5 0.008856 

y 

whitepo mt cam 

Then ^ re£ * meas ~ 7 787^ ^ re< ^ w««r ~ 

y whitepo int cam ^ y^ whitepo int cam ^£ 



1/3 

* 7 • * 7 • 

whitepo int cam y* whitepo int cam 96 



Then 



' pred meas 8 0.008856 



whitepo int cam 

* Z ^ • 

♦z 

y whitepo int caw ^£ 



* Z 

^ prea 1 w<?a^ 



* z . • 

7 787 ^ meas — 

♦7 -5- 

y whitepo int cam 56 



♦z 

y whitepo int caw ^ y whitepo int caw ^ 



* Z . • 

♦7 



1/3 



The equation for meas L 132 for the predicted measurement values is as follows 
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V Y pred meas 5 0.008856 
Then measL' pre d meas 100 9.0337^^ 
r Else meas £ pred meas 1001.167^ meas 1/3 0.16 

The equation for meas a 134 for the predicted measurement values is as follows: 

* * X A • 

^ caa4/4 pretf /near . /■ a meoy . _u 

meas a pre d meas 500*/* — - fz — ~ ~* 

▼ tX * 4 F ~^ 

y y whitepo mt cam ^ y^ whitepo int caw 5^ 

The equation for meas b 136 for the predicted measurement values is as follows: 
meas o pred meas 200 v? — ^ " ./ I — ~* 

y y* whitepo int cam ^ y^ whitepo int carm 

The equation for meas C 138 for the predicted measurement values is as follows: 

meaS C* pred meas *\j me aS a* pred meas meaS t* pred 



2 

meas 



1 5 Once these values have been calculated, the differences between these two sets are 

calculated. Specifically, calculation 140 utilizes the following equation: 

$L measL pre d meas meaS Lf norm cam 

The equation to calculate delta a* 142 is as follows: 

20 

3 a* meaS 0* pred meas meaS a* norm cam 

The equation to calculate delta b* 144 is as follows: 

2 5 3 b * meaS b * pred meas meaS b * norm cam 

The equation to calculate delta C 146 is as follows: 

bC measC pred meas meaS C norm cam 

30 

The CIE color difference equation is then used to calculate delta E is as follows: 

BE* JbL* 2 bg 2 Bb' 2 

3 5 The equation to calculate delta H 1 50 is as follows: 
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If 3 £* 2 3Z* 2 aC* 2 0 
Then bH* 0 



Else 3tf* V9£* 2 aX* 2 3C n 

With these factors now calculated, the CIE 1996 compensation factors may be 
5 calculated as indicated at calculation blocks 1 52, 1 54, and 156 with the following 
equations: 

L al* 

comp 

I ^ comp 



H 



1 0.045 \measC 



comp * 

\f* ■ 1 0.015 measC 

*H From these factors, calculation block 158 may be performed using the following 

equation: 

a is 



*E*CIE9A ^L comp 2 C comp 2 H comp 2 



Once calculation 158 has been performed, its result is checked 160 to determine if 
the predicted accuracy is acceptable. Typically, this value is required to be 6 or less, and 

20 a value of 3 or less is desired. If the accuracy is not sufficient, an error is logged 162. 
This may be due to the capture device having gamma compensation turned on or some 
other compensation that cannot be turned off. As stated above, the gamma is assumed to 
be approximately 1 .0, If this is not the case, a simple tone compensation based on the 
estimate of the actual gamma may be accomplished to estimate what the right count 

2 5 actually is. The estimation of gamma in this case may be accomplished in a known 
manner with as little as three points. If at least 7 points are known, a spline fit may be 
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accomplished. If the predicted accuracy is achieved, the predicted measurement values 
are converted 164 using the simplified Bradford white point adaptation equations from 
the capture device's white point or color space, to the D65 white point. As discussed 
above, the full CIE Bradford algorithm, as well as others, may also be used as desired. In 
the exemplary embodiment, however, the conversion is as follows: 



wpt D65 



* AS 

&X3 Translation- 

<H>v ^ « ^ZBradford y v 
Matrix Camera 4 ^ ~ ^ 0 

\t ~ T <Rever.se ~ <-> 

0o D65 Wht. PL « 

^^Matrix 



0 



= wp/ cam 



0 



w/w/ 1 £>65 



0 



♦ 
♦ 



0 



wpf cam 

B 



wpt D65 



B 



&X3 

*J^radford[ 
^Forward ? 
~+^fatrix \ 



wpt cam 1 1 ^ 



*X D65 = &X3Translation=*X pr e d mens** 
2)65 Z ^atrix Camera 



*pred 



■'D65 ... V- ••4l± pred meas 

If anyX D6S ,Y D65 ,orZ D65 0 



r/z<?HX D65 ,7„ 65 ,orZ 



'D65 



0 



These values are then further converted 166 using the CIE XYZ to RGB matrix 
from the IEC 61966-2-1 sRGB Standard from D65 to linear RGB values as follows: 
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*R'= 43X3 Translation^ a¥" d65 = 
§'! Matrix D65To % 
£§ f f„ linear RGB *%2 D65 * t 



&X3Translation= * 3.2406 1.5372 0.4986= 



where ^tfatrix D65 To 



0.9689 1.8758 0.0415' 



linear RGB 



^0.0557 0.2040 1.0570* 



Finally, these linear RGB values are converted 168 in accordance with the 
nonlinear tone equations from IEC 61966-2-1 to sRGB output values in the exemplary 
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embodiment. As discussed above, however, other RGB color spaces may be output by 

the appropriate conversion, such as sRGB64, AdobeRGB, etc. as desired. This sRGB is a 

standard, device independent color space used on the Internet and in television. This final 

transformation allows the digital capture device to output calibrated values that may be 

5 directly transmitted over the Internet. These values are calculated as follows: 

IfR' 0, 

ThenR sRGB 0, 

Else IfR' 0.00304, 

Then R sRGB 12.92R' 255, 

Else IfK I 1, 

ThenR S RGB 25 5 > 

Else R sRGB 2551.055i?' 1/2 - 4 0.055 

IfG' 0, 

Then G sRGB 0, 

Else IfG' 0.00304, 

Then G sRGB 12.92G' 255, 

Else IfG'\ 1, 

Then G sRGB 255, 

Else G sRGB 2551.055G' 172 - 4 0.055 

IfB' 0, 
ThenB sRGB °> 
Else IfB' 0.00304, 
10 ThenB sRGB 12.925' 255, 

Else IfB'l 1, 

ThenB sRGB 255, 

ElseB earK 2551.0555 ,1/24 0.055 



As is now apparent, this method performs two white point conversions. The first 
is from the test target space to the device space. The device space is where all of the 
processing is accomplished, unlike prior methods. Once this processing has been 
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completed, a second transformation from the device space to a device independent 
communication space, such as sRGB, sRGB64, AdobeRGB, etc., is performed to allow 
the digital image to be communicated to other devices in a known space. 

Once the above calibration has been performed and the color fidelity has been 
verified to be acceptable, a single 3X3 compensation matrix may be developed as 
follows: 



SX3 Translation^ &X3 Translations *R r e g res S x G regressX B re g ressx ^ 43X3 = 
^atrixD65To l+^atrix Camera ™& mY G mY B mY n+ Compensation* 
linear RGB »*&>D65Wht.Pt. *% gressZ G regressZ B regressZ % ^Matrix * 



This compensation matrix may then be downloaded into fixed math or floating 
point firmware in the capture device hardware to allow conversion from the raw capture 
1 0 device image data directly to sRGB for output to the system as illustrated in Figure 5. 
Specifically, the digital image capture device 172 outputs the raw RGB data 174 of the 
captured image, which is then normalized 176 to a range of 0-1 as follows: 

D D 

D raw raw min 

raw norm 



R R 

raw rain raw max 



raw rav; min 



raw norm s~i ^ 

raw min raw max 



B B 

j£ raw raw min 



raw norm p p 

raw min raw max, 
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This normalized RGB data 176 is then matrix multiplied by the 3X3 
compensation matrix 178 calculated above in the capture device's image data 
compensation firmware 180 as follows: 
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_ 4R raw mrm — — 
%ompensation^ raw norm * g'J 
Matrix J@ rawnorm *. $8'*. 

The output from this image data compensation 180 is then converted 182 to the 

device independent color space, e.g. sRGB, for output from the capture device as follows: 

IfR! 0, 

Then R sRGB 0, 

Else IfR' 0.00304, 

ThenR sRGB 12.92/?' 255, 

Else IfR'l 1, 

Then R sRGB 255, 

Else R sRGB 255 1.055i?' 1/24 0.055 

i/cr 0, 

ThenG sRGB 0, 

Else IfG' 0.00304, 

Then G sRGB 12.92G' 255, 
Else IfG' I 1, 

Then G sRGB 255, 

Else G sRGB 2551.055G' 1 ' 24 0.055 



IfB' 0, 

Then B sRGB 0, 

Else IfB' 0.00304, 



ThenB sRGB 12.925' 255, 



£/se #5'! 1, 

ThenB sRGB 255, 
Else B sRGB 2551.0555' 1/24 0.055 
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If an ICC profile is desired or required, the 3X3 matrix of expected measurement 
values calculated in step 116 and a simple tone curve fit of the gray scale data can be used 
to develop the ICC profile in a known manner. 
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All of the references cited herein, including patents, patent applications, and 
publications, are hereby incorporated in their entireties by reference. 

In view of the many possible embodiments to which the principles of this 
invention may be applied, it should be recognized that the embodiment described herein 
5 with respect to the drawing figures is meant to be illustrative only and should not be taken 
as limiting the scope of invention. For example, those of skill in the art will recognize 
that the elements of the illustrated embodiment shown in software may be implemented 
in hardware and vice versa or that the illustrated embodiment can be modified in 
arrangement and detail without departing from the spirit of the invention. Therefore, the 
1 0 invention as described herein contemplates all such embodiments as may come within the 
scope of the following claims and equivalents thereof. 
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CLAIMS 

I claim: 

1 . A method of calibrating a digital image capture device, comprising the 
steps of: 

acquiring a test target; 

determining measurement values from the test target; 

normalizing the measurement values to a range of 0 to 1; 

determining white point chromaticity for the digital image capture device; 

converting the normalized measurement values to the digital image capture device 
white point chromaticity; 

capturing raw color values of the test target with the digital image capture device; 

normalizing the captured raw color values to a range of 0 to 1 ; 

regressing the normalized measurement values with the normalized raw color 
values to determine a first compensation matrix; and 

verifying a level of color fidelity of the digital image capture device. 

2. The method of claim 1, wherein the step of determining measurement 
values from the test target comprises the step of accepting published measurement values 
for the test target in a physical color space. 

3 . The method of claim 1 , wherein the step of determining measurement 
values from the test target comprises the step of measuring the test target with calibrated 
test equipment in a physical color space. 
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4. The method of claim 1, wherein the step of converting the normalized 
measurement values to the digital image capture device white point chromaticity 
comprises the step of using simplified Bradford white point adaptation equations to bring 

5 the normalized measurement values into the capture device color space. 

5. The method of claim 1, wherein the step of capturing raw color values of 
the test target with the digital image capture device comprises the step of disabling any 
gamma correction function of the capture device prior to capturing raw color values of the 

1 0 test target. 



measurement values with the normalized raw color values to determine a first 
compensation matrix comprises the steps of assigning the normalized measurement 
15 values from the test target converted to the capture device white point as the dependent 
data, and assigning the normalized raw color data as the independent data. 



6. 



The method of claim 1, wherein the step of regressing the normalized 



7. 



The method of claim 6, further comprising the step of forcing a y-intercept 



of the regression to zero. 
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8. 



The method of claim 6 5 wherein the step of regressing is performed on an 



electronic spreadsheet. 
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9. The method of claim 1 , wherein the step of verifying a level of color 
fidelity of the digital image capture device comprises the steps of: 

matrix multiplying the first compensation matrix with the normalized raw color 
data to obtain predicted measurement values; 

comparing the normalized test target measurement values converted to the capture 
device white point with the predicted measurement values to obtain the CIE 1996 color 
difference values, including aE CIE94; and 

checking 3 E CIE94 against a predetermined threshold for acceptable color 
fidelity. 

10. The method of claim 9, wherein the step of comparing the normalized test 
target measurement values converted to the capture device white point with the predicted 
measurement values comprises the step of converting the normalized test target 
measurement values converted to the capture device white point and the predicted 
measurement values to the CIEL*a*b* color space. 

1 1 . The method of claim 9, wherein the step of checking s E*CIE94 against a 

* 

predetermined threshold for acceptable color fidelity reveals that 3 E CIE94 is larger than 
the predetermined threshold, further comprising the step of logging an error. 

12. The method of claim 9, wherein the step of checking s E CIE94 agamst a 
predetermined threshold for acceptable color fidelity reveals that a E CIE94 is equal to or 
smaller than the predetermined threshold, further comprising the steps of: 



calculating a second compensation matrix for compensating raw color data from 
the capture device; and 

downloading the second compensation matrix into the capture device. 

13. The method of claim 12, wherein the step of calculating a second 
compensation matrix comprises the step of translating the first compensation matrix from 
capture device color space to a device independent color space. 

14. The method of claim 1 , wherein the step of acquiring a test target 
comprises the step of developing a customized test target for a particular application. 

15. The method of claim 1 , wherein the step of acquiring a test target 
comprises the step of acquiring a test target with at least six color patches thereon. 

1 6. The method of claim 1 5, wherein said at least six color patches include a 
white patch, a black patch, a gray patch, and three orthogonal colors. 

17. The method of claim 16, wherein the gray patch is in the range of 25% to 
75% gray. 

18. The method of claim 1, wherein the step of acquiring a test target 
comprises the step of acquiring a test target whose spectral makeup is representative of 
the type of material of the objects whose digital images will be captured. 
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19. A method of achieving high color fidelity in a digital image capture 
device, comprising the steps of: 

capturing color data from an image; 

normalizing the color data to both black and white; and 

compensating the normalized color data with a compensation matrix. 

20. The method of claim 1 9, further comprising the step of converting the 
compensated normalized color data from a color space of the capture device to a device 
independent color space. 

2 1 . The method of claim 1 9, wherein the step of compensating the normalized 
color data with a compensation matrix comprises the step of calibrating the capture 
device through the following steps: 

acquiring a test target; 

determining measurement values from the test target; 
normalizing the measurement values to both black and white; 
determining white point chromaticity for the digital image capture device; 
converting the normalized measurement values to the digital image capture device 
color space; 

capturing raw color values of the test target with the capture device; 
normalizing the captured raw color values to both black and white; and 
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regressing the normalized measurement values with the normalized raw color 
values to determine the compensation matrix in the color space of the capture device. 

22. The method of claim 21, further comprising the step of verifying a level of 
5 color fidelity of the digital image capture device by calculating color difference 

parameters between the normalized measurement values converted to the capture device 
color space and the normalized raw color data compensated by the compensation matrix 
in the capture device color space. 

10 23, A digital image capture device, comprising a memory storage element 

having stored therein a compensation matrix calculated as a regression of normalized raw 
color data from a test target and normalized measurement data from the test target 
converted to the color space of the capture device. 

15 24. The digital image capture device of claim 23, further comprising 

processing means for normalizing captured color data of an image to black and white, 
said processing means further compensating the normalized captured color data with the 
compensation matrix to achieve high color fidelity. 

20 25. The digital image capture device of claim 24, wherein said processing 

means further converts the compensated normalized color data from a color space of the 
capture device to a device independent color space. 
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ABSTRACT OF THE INVENTION 

A system and method for calibration of digital image capture devices is presented 
that allows the further development of e-commerce by ensuring that the digital image 
accurately represents the colors of the captured image. This simplified method provides a 
calibration of the relationship between a digital image capture device output and the 
human visual perception of the colors input into the device using easily available and 
affordable test targets, measurement devices, and software with a minimum of labor and 
expertise. This analysis may be performed using the data analysis tools of a conventional 
electronic spreadsheet having matrix multiplication and regression capability. 
Specifically, the method normalizes the test target data to both black and white, and 
converts the normalized data into the color space of the capture device through white 
point adaptation. The raw captured image data is also normalized to both black and 
white, and is regressed with the converted, normalized target data to determine the 
expected measurement values. These values are used to compensate the device output to 
achieve a high level of color fidelity. To ensure that the level of fidelity is acceptable, the 
CIE color difference equations are used. 
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